Systems and methods for facilitating a transaction relating to newly identified items using augmented reality

ABSTRACT

A system may provide an augmented environment that facilitates a transaction. The system may store profile data including user payment or user profile information. The system may then receive environmental data including audio and visual information representing a physical environment. The system may then receive first user input data indicative of a selection of one or more items present in the physical environment, and identify one or more action items in the environmental data based on the first user input data. In response to this identification, the system may augment the environmental data by adding virtual environmental data, and then provide this virtual environmental data to a device to create an augmented environment. The system can then receive second user input data, and provide purchase request data to a merchant terminal to enable a transaction related to the one or more action items.

CROSS-REFERENCE TO RELATED APPLICATION

This application claims the benefit of U.S. Provisional Application No.62/437,711, filed 22 Dec. 2016, the entire contents and substance ofwhich is hereby incorporated by reference.

FIELD OF INVENTION

The present disclosure relates to systems and methods for facilitating atransaction using augmented reality, and more particularly facilitatinga transaction relating to one or more newly identified items using aninteractive augmented environment.

BACKGROUND

Most people routinely see items that they are interested in purchasingin locations outside of a merchant or storefront. For example, a firstperson may be walking down the street and see an item of interest, suchas a particular shirt that a second person is wearing or a handbag thesecond person is carrying, and the first person may desire to purchasethe shirt or handbag for themselves. However, typically there is no wayfor an individual to immediately purchase items that they see as theymove through the world outside of the merchant or shopping location.When coming across a desired item, a person must generally identify theitem, remember it, and locate a merchant to purchase the item from at alater time. While this tedious process is manageable for a single itemof note (e.g., an automobile purchase) or when it is convenient topurchase the item immediately or shortly after identifying it (e.g.,while at or en route to the merchant location), it can be oftentimesburdensome for a person to accurately identify the item (e.g., the brandor model) or several items, identify a merchant that sells theidentified item(s), and remember that information later on when theperson can conveniently purchase the item(s), particularly if the personis involved in another non-shopping task when coming across the item(s).

Accordingly, there is a need for systems and methods for facilitating atransaction of previously unidentified items using augmented reality orvirtual reality. Such systems can be non-invasive to an individual's dayand can provide the ability to identify items of interest and completetransactions instantaneously. Embodiments of the present disclosure aredirected to this and other considerations.

SUMMARY

Disclosed embodiments provide systems and methods for facilitating atransaction using augmented reality.

Consistent with the disclosed embodiments, the system may include one ormore memory devices storing instructions, and one or more processorsconfigured to execute the instructions to perform steps of a method tofacilitate a transaction using augmented reality. The system may storeprofile data including user payment or other profile information. Thesystem may then receive environmental data that may include audio andvisual information representing a physical environment. The system mayreceive first user input data indicative of a selection of one or moreitems present in the physical environment, and identify one or moreaction items in the environmental data based on the first user inputdata. In response to this identification, the system may augment theenvironmental data by adding virtual environmental data, and thenprovide this virtual environmental data to a device. The system can thenreceive second user input data, and provide purchase request data to amerchant terminal to complete a transaction based on the second userinput data, the one or more action items, and the user profileinformation.

Consistent with the disclosed embodiments, methods for providing anaugmented environment that facilitates a transaction are also provided.

Further features of the disclosed design, and the advantages offeredthereby, are explained in greater detail hereinafter with reference tospecific embodiments illustrated in the accompanying drawings, whereinlike elements are indicated be like reference designators.

BRIEF DESCRIPTION OF THE DRAWINGS

Reference will now be made to the accompanying drawings, which are notnecessarily drawn to scale, and which are incorporated into andconstitute a portion of this disclosure, illustrate variousimplementations and aspects of the disclosed technology and, togetherwith the description, serve to explain the principles of the disclosedtechnology. In the drawings:

FIG. 1 is a diagram of an exemplary system that may be used to generatean augmented environment and facilitate a transaction;

FIG. 2 is a component diagram of an exemplary service provider terminal;

FIG. 3 is a flowchart of an exemplary method for generating an augmentedenvironment and facilitating a transaction;

FIG. 4 is a diagram of exemplary types of virtual environmental data;and

FIG. 5 is a component diagram of an exemplary computing device.

DETAILED DESCRIPTION

Some implementations of the disclosed technology will be described morefully with reference to the accompanying drawings. This disclosedtechnology may, however, be embodied in many different forms and shouldnot be construed as limited to the implementations set forth herein. Thecomponents described hereinafter as making up various elements of thedisclosed technology are intended to be illustrative and notrestrictive. Many suitable components that would perform the same orsimilar functions as components described herein are intended to beembraced within the scope of the disclosed electronic devices andmethods. Such other components not described herein may include, but arenot limited to, for example, components developed after development ofthe disclosed technology.

It is also to be understood that the mention of one or more method stepsdoes not preclude the presence of additional method steps or interveningmethod steps between those steps expressly identified. Similarly, it isalso to be understood that the mention of one or more components in adevice or system does not preclude the presence of additional componentsor intervening components between those components expressly identified.

The disclosed embodiments are directed to systems and methods forgenerating an augmented environment and facilitating a transaction. Thesystem may include one or more memory devices storing instructions, andone or more processors configured to execute the instructions to performsteps of a method. Specifically, in some embodiments, the system mayprovide an augmented environment that facilitates a transaction. Toaccomplish this, the system may execute the instructions to storeprofile data including user payment or other profile information. Thesystem may then receive environmental data that may include audio andvisual information representing a physical environment. The system mayreceive first user input data indicative of a selection of one or moreitems present in the physical environment, and identify one or moreaction items in the environmental data based on the first user inputdata. In response to this identification, the system may augment theenvironmental data by adding virtual environmental data, and thenprovide this virtual environmental data to a device. Having provided thevirtual data to the computing device, the system may then receive seconduser input data and provide purchase request data to a merchant terminalto complete a transaction based on the second user input data, the oneor more action items, and the user profile information.

In another embodiment, a system for facilitating a transaction mayinclude a memory for storing profile data comprising user paymentcredentials and user profile information. The system may include anenvironmental data sensor for obtaining environmental data comprisingaudio and/or visual information representing a physical environment. Thesystem may include a user interface device for generating user inputdata in response to one or more user inputs that may include first userinput data indicative of a selection of one or more items present in thephysical environment. The system may include an input/output device fortransmitting the purchase request data to a merchant terminal. Thesystem may further include an augmented environment processor that,based on the first user data and environmental data obtained from theenvironmental data sensor, may identify one or more action items in theenvironmental data that are associated with the one or more selecteditems, augment the environmental data by adding the virtualenvironmental data comprising enhanced content associated with one ormore of the one or more action items, generate a signal comprisingaugmented environmental data, and generate purchase request data basedon the one or more action items, the user profile information, andsecond user input data associated with one or more action itemsgenerated by the user interface device. Enhanced content may be contentthat is unrepresented in the physical environment. The system mayfurther include an augmented environmental data display that may receivethe signal comprising augmented environmental data and display saidaugmented environmental data in accordance with said signal.

In another aspect, a non-transitory computer-readable medium storinginstructions is disclosed. The instructions, when executed by one ormore processors, may cause a computing device to perform steps of amethod for generating an augmented environment and facilitating atransaction. Specifically, the computing device may store profile dataincluding user payment or other profile information and receiveenvironmental data. The system may receive environmental data that mayinclude audio and visual information representing a physicalenvironment. The computing device may then receive first user input dataindicative of a selection of one or more items present in the physicalenvironment, and identify one or more action items in the environmentaldata. This identification can result in the system augmenting theenvironmental data by adding virtual environmental data, and thenproviding this virtual environmental data to a device. The computingdevice may then receive second user input data, and provide purchaserequest data to a merchant terminal to complete a transaction based onthe second user input data, the one or more action items, and the userprofile information.

In another aspect, a method for facilitating a transaction usingaugmented reality is disclosed. The disclosed method can include storingprofile data including user payment or other profile information. Next,the method may include receiving environmental data that may includeaudio and visual information representing a physical environment. Themethod may include receiving first user input data indicative of aselection of one or more items present in the physical environment, andidentifying one or more action items in the environmental data based onthe first user input data. In response to this identification, themethod may include augmenting the environmental data by adding virtualenvironmental data, and then providing this virtual environmental datato a computing device. Having provided the virtual data to the computingdevice, the method may include receiving second user input data andproviding purchase request data to a merchant terminal to complete atransaction based on the second user input data, the one or more actionitems, and the user profile information.

Reference will now be made in detail to exemplary embodiments of thedisclosed technology, examples of which are illustrated in theaccompanying drawings and disclosed herein. Wherever convenient, thesame references numbers will be used throughout the drawings to refer tothe same or like parts.

FIG. 1 is a diagram of an exemplary system that may be configured toperform one or more processes that can generate interactive virtualelements to augment an environment. The components and arrangementsshown in FIG. 1 are not intended to limit the disclosed embodiments asthe components used to implement the disclosed processes and featuresmay vary.

In accordance with disclosed embodiments, transaction facilitatingsystem 100 may include a service provider terminal 110 in communicationwith a computing device 120 via network 130. In some embodiments,service provider terminal 110 is also in communication with a merchantdatabase terminal 140 via network 130. Computing device 120 may be amobile computing device (e.g., a smart phone, tablet computer, smartwearable device, portable laptop computer, voice command device, orother mobile computing device) or a stationary computing device (e.g., astationary desktop or other stationary computer). Computing device 120may belong to or be provided by a consumer, or may be borrowed, rented,or shared. In some embodiments, computing device 120 may be configuredto provide one or more of an augmented reality and/or a virtual realityexperience to one or more users, and may be equipped with a visualdisplay (which may be referred to as a “display”), speakers or otherauditory devices, tactile simulators, and other devices configured toengage the user's senses to enhance the augmented/virtual realityexperience.

In some embodiments, transaction facilitating system 100 may connect toa merchant database terminal 140 that communicates with other devices ofsystem 100 via network 130. Optionally, in some embodiments, interactivevirtual/augmented environment system 100 may also include a merchantpoint of sale (POS) terminal 150 that communicates with other devices ofsystem 100 via network 130. Additionally, in some embodiments,interactive virtual/augmented environment system 100 may also include afinancial service provider terminal 160 that communicates with otherdevices of system 100 via network 130.

Network 130 may be of any suitable type, including individualconnections via the internet such as cellular or WiFi networks. In someembodiments, network 130 may connect terminals using direct connectionssuch as radio-frequency identification (RFID), near-field communication(NFC), Bluetooth™, low-energy Bluetooth™ (BLE), WiFi™, ZigBee™, ambientbackscatter communications (ABC) protocols, USB, or LAN. Because theinformation transmitted may be personal or confidential, securityconcerns may dictate one or more of these types of connections beencrypted or otherwise secured. In some embodiments, however, theinformation being transmitted may be less personal, and therefore thenetwork connections may be selected for convenience over security.

An exemplary embodiment of service provider terminal 110 is shown inmore detail in FIG. 2. Computing device 120, merchant database terminal140, merchant POS terminal 150, and financial service provider terminal160 may have a similar structure and components that are similar tothose described with respect to service provider terminal 110. As shown,service provider terminal 110 may include a processor 210, aninput/output (“I/O”) device 220, a memory 230 containing an operatingsystem (“OS”) 240 and a program 250. For example, service providerterminal 110 may be a single server or may be configured as adistributed computer system including multiple servers or computers thatinteroperate to perform one or more of the processes and functionalitiesassociated with the disclosed embodiments. In some embodiments, theservice provider terminal 110 may further include a peripheralinterface, a transceiver, a mobile network interface in communicationwith the processor 210, a bus configured to facilitate communicationbetween the various components of the service provider terminal 110, anda power source configured to power one or more components of the serviceprovider terminal 110.

A peripheral interface may include the hardware, firmware and/orsoftware that enables communication with various peripheral devices,such as media drives (e.g., magnetic disk, solid state, or optical diskdrives), other processing devices, or any other input source used inconnection with the instant techniques. In some embodiments, aperipheral interface may include a serial port, a parallel port, ageneral purpose input and output (GPIO) port, a game port, a universalserial bus (USB), a micro-USB port, a high definition multimedia (HDMI)port, a video port, an audio port, a Bluetooth™ port, a near-fieldcommunication (NFC) port, another like communication interface, or anycombination thereof.

In some embodiments, a transceiver may be configured to communicate withcompatible devices and ID tags when they are within a predeterminedrange. A transceiver may be compatible with one or more of:radio-frequency identification (RFID), near-field communication (NFC),Bluetooth™, low-energy Bluetooth™ (BLE), WiFi™, ZigBee™, ambientbackscatter communications (ABC) protocols or similar technologies.

A mobile network interface may provide access to a cellular network, theInternet, or another wide-area network. In some embodiments, a mobilenetwork interface may include hardware, firmware, and/or software thatallows the processor(s) 210 to communicate with other devices via wiredor wireless networks, whether local or wide area, private or public, asknown in the art. A power source may be configured to provide anappropriate alternating current (AC) or direct current (DC) to powercomponents.

Processor 210 may include one or more of a microprocessor,microcontroller, digital signal processor, co-processor or the like orcombinations thereof capable of executing stored instructions andoperating upon stored data. Memory 230 may include, in someimplementations, one or more suitable types of memory (e.g. such asvolatile or non-volatile memory, random access memory (RAM), read onlymemory (ROM), programmable read-only memory (PROM), erasableprogrammable read-only memory (EPROM), electrically erasableprogrammable read-only memory (EEPROM), magnetic disks, optical disks,floppy disks, hard disks, removable cartridges, flash memory, aredundant array of independent disks (RAID), and the like), for storingfiles including an operating system, application programs (including,for example, a web browser application, a widget or gadget engine, andor other applications, as necessary), executable instructions and data.In one embodiment, the processing techniques described herein areimplemented as a combination of executable instructions and data withinthe memory 230.

Processor 210 may be one or more known processing devices, such as amicroprocessor from the Pentium™ family manufactured by Intel™ or theTurion™ family manufactured by AMD™. Processor 210 may constitute asingle core or multiple core processor that executes parallel processessimultaneously. For example, processor 210 may be a single coreprocessor that is configured with virtual processing technologies. Incertain embodiments, processor 210 may use logical processors tosimultaneously execute and control multiple processes. Processor 210 mayimplement virtual machine technologies, or other similar knowntechnologies to provide the ability to execute, control, run,manipulate, store, etc. multiple software processes, applications,programs, etc. One of ordinary skill in the art would understand thatother types of processor arrangements could be implemented that providefor the capabilities disclosed herein.

Service provider terminal 110 may include one or more storage devicesconfigured to store information used by processor 210 (or othercomponents) to perform certain functions related to the disclosedembodiments. In one example, service provider terminal 110 may includememory 230 that includes instructions to enable processor 210 to executeone or more applications, such as server applications, networkcommunication processes, and any other type of application or softwareknown to be available on computer systems. Alternatively, theinstructions, application programs, etc. may be stored in an externalstorage or available from a memory over a network. The one or morestorage devices may be a volatile or non-volatile, magnetic,semiconductor, tape, optical, removable, non-removable, or other type ofstorage device or tangible computer-readable medium.

In one embodiment, service provider terminal 110 may include memory 230that includes instructions that, when executed by processor 210, performone or more processes consistent with the functionalities disclosedherein. Methods, systems, and articles of manufacture consistent withdisclosed embodiments are not limited to separate programs or computersconfigured to perform dedicated tasks. For example, service providerterminal 110 may include memory 230 that may include one or moreprograms 250 to perform one or more functions of the disclosedembodiments. Moreover, processor 210 may execute one or more programs250 located remotely from system 100. For example, system 100 may accessone or more remote programs 250, that, when executed, perform functionsrelated to disclosed embodiments.

Memory 230 may include one or more memory devices that store data andinstructions used to perform one or more features of the disclosedembodiments. Memory 230 may also include any combination of one or moredatabases controlled by memory controller devices (e.g., server(s),etc.) or software, such as document management systems, Microsoft™ SQLdatabases, SharePoint™ databases, Oracle™ databases, Sybase™ databases,or other relational databases. Memory 230 may include softwarecomponents that, when executed by processor 210, perform one or moreprocesses consistent with the disclosed embodiments. In someembodiments, memory 230 may include a merchant information database 260,an environment database 270, and a virtual environmental database 280for storing related data to enable service provider terminal 110 toperform one or more of the processes and functionalities associated withthe disclosed embodiments. Merchant information database 260 may includestored data relating to product price, product inventory, relatedproducts, and available discounts associated with one or more productsassociated with one or more merchants. Environment database 270 mayinclude stored data relating to a physical environment that is capturedby one or more devices (e.g., computing device 120) of system 100.Virtual environment database 280 may include stored data relating to avirtual environment that is provided to and can be updated based uponinteractions with one or more devices (e.g., computing device 120) ofsystem 100.

Service provider terminal 110 may also be communicatively connected toone or more memory devices (e.g., databases (not shown)) locally orthrough a network. The remote memory devices may be configured to storeinformation and may be accessed and/or managed by service providerterminal 110. By way of example, the remote memory devices may bedocument management systems, Microsoft™ SQL database, SharePoint™databases, Oracle™ databases, Sybase™ databases, or other relationaldatabases. Systems and methods consistent with disclosed embodiments,however, are not limited to separate databases or even to the use of adatabase.

Service provider terminal 110 may also include one or more I/O devices220 that may comprise one or more interfaces for receiving signals orinput from devices and providing signals or output to one or moredevices that allow data to be received and/or transmitted by serviceprovider terminal 110. For example, service provider terminal 110 mayinclude interface components, which may provide interfaces to one ormore input devices, such as one or more keyboards, mouse devices, touchscreens, track pads, trackballs, scroll wheels, digital cameras,microphones, sensors, and the like, that enable service providerterminal 110 to receive data from one or more users (such as viacomputing device 120).

In exemplary embodiments of the disclosed technology, service providerterminal 110 may include any number of hardware and/or softwareapplications that are executed to facilitate any of the operations. Theone or more I/O interfaces may be utilized to receive or collect dataand/or user instructions from a wide variety of input devices. Receiveddata may be processed by one or more computer processors as desired invarious implementations of the disclosed technology and/or stored in oneor more memory devices.

While service provider terminal 110 has been described as one form forimplementing the techniques described herein, those having ordinaryskill in the art will appreciate that other, functionally equivalenttechniques may be employed. For example, as known in the art, some orall of the functionality implemented via executable instructions mayalso be implemented using firmware and/or hardware devices such asapplication specific integrated circuits (ASICs), programmable logicarrays, state machines, etc. Furthermore, other implementations of theterminal 110 may include a greater or lesser number of components thanthose illustrated.

Merchant database terminal 140 may have one or more processors 142 andone or more merchant databases 144, which may be any suitable repositoryof merchant data. Merchant database terminal 140 may be located at thePOS location, off-site at another merchant location, or at a third partylocation. Information stored in merchant database terminal 140 may beaccessed (e.g., retrieved, updated, and added to) via network 130 by oneor more devices (e.g., service provider terminal 110) of system 100.Merchant database 144 may store information relating to products andservices offered by merchants such as pricing, quantity, availability,discounts, reviews, and any other such information that a consumer mayutilize in making a purchasing decision. In some embodiments, merchantdatabase 144 may also include location information associated withproducts and services that identifies the location(s) that a particularproduct or service is available for purchase. In some embodiments, thelocation information may include an identification of a particularstore, terminal, or kiosk that the product or service may be purchasedfrom.

Merchant POS terminal 150 may have one or more POS devices 152, 154, 156that communicate with one or more devices (e.g., computing device 120)of system 100 via network 130. In some embodiments, POS devices 152,154, 156 may be associated with one or more products or items at a POSlocation, and may serve as beacons to identify the associated productsor items and related information to one or more devices of system 100.In other embodiments, merchant POS terminal 150 may be configured toprocess online transactions on behalf of the associated merchant.

Financial service provider terminal 160 may have one or more processors162 and one or more financial service provider databases 164, which maybe any suitable repository of merchant data. Financial service providerterminal 160 may be located at the POS location, off-site at anotherfinancial service provider location, or at a third party location.Information stored in financial service provider database 164 may berequested and sent to one or more devices (e.g., service providerterminal 110, merchant POS terminal 150) of system 100 via network 130.

FIG. 5 shows an exemplary embodiment of computing device 120. As shown,computing device 120 may include input/output (“I/O”) device 220 fortransmitting purchase request data to a merchant POS terminal 150,memory 230 for storing profile data comprising user payment credentialsand user profile information and containing operating system (“OS”) 240and program 250 and all associated components as described above withrespect to service provider terminal 110. Computing device 120 may alsohave one or more processors, including an augmented environmentprocessor 502 for generating signals representative of augmented and/orvirtual environments, a geographic location sensor (“GLS”) 504 fordetermining the geographic location of computing device 120 and/or anassociated environmental data sensor 508, an augmented environmentaldata display 506 for displaying augmented environmental data, anenvironmental data (“ED”) sensor 508 for obtaining environmental dataincluding audio and/or visual information representing a physicalenvironment, and a user interface (“U/I”) device 510 for receiving userinput data associated with one or more action items. According to someembodiments, a user interface device 510 may include some or all of thecomponents described with respect to input/output device 220 above. Insome embodiments, environmental data sensor 508 may include a microphoneor a digital camera. According to some embodiments, augmentedenvironment processor 502 may include all of the features and functionsof processor 210 described above. Further, augmented environmentprocessor 502 may be configured to, based on the first user data andenvironmental data obtained from the environmental data sensor, identifyone or more action items in the environmental data that are associatedwith the one or more selected items (e.g., environment processor 502 mayapply image recognition techniques to an object that a user made agesture towards), augment the environmental data by adding the virtualenvironmental data comprising enhanced content associated with one ormore of the one or more action items (e.g., environment processor 502may associate merchant information with an identified item), generate asignal comprising augmented environmental data, and generate purchaserequest data based on the one or more action items, the user profileinformation, and second user input data associated with one or moreaction items generated by the user interface device. Enhanced contentmay be content that is unrepresented in the physical environment. Theaugmented environmental data display 506 may be configured to receivethe signal comprising augmented environmental data and display theaugmented environmental data in accordance with the signal.

According to some embodiments, based on the user input data, the one ormore action items, and the user profile information, the input/outputdevice 220 may be configured to provide purchase request data to amerchant terminal 150 to enable a transaction related to the one or moreaction items, wherein the purchase request data comprises the storeduser payment credentials. In some embodiments, the first user input datamay be generated in response to a first gesture indicating selection ofan item that is present in the physical environment. In someembodiments, the second user input data may be generated in response toa second gesture indicating an instruction to purchase an item.

FIG. 3 shows a flowchart of method 300 for generating an augmentedenvironment and facilitating a transaction. Method 300 may be performedby service provider terminal 110 using processor 210 to execute memory230. In some embodiments, one or more steps of method 300 may bedelegated to other devices or systems in system 100, such as computingdevice 120, merchant database terminal 140, merchant POS terminal 150and/or financial service provider terminal 160. Following method 300,user(s) may generate, share, and modify virtually augmentedenvironments.

In block 310, service provider terminal 110 may store profile data.Profile data may include information such as payment credentials and/oruser profile information. Profile data may be entered directly by a user(e.g., via computing device 120 or merchant POS terminal 150), or storedon and retrieved from merchant database terminal 140 or financialservice provider terminal 160. Payment credentials may include creditcard information or financial account information (e.g., which may beassociated with financial service provider terminal 160), authenticationdata (e.g., pin, password, secure gesture, signature, etc.) or otherfinancial information as needed to initiate and authorize a payment,while profile information can include delivery locations, userpreferences for clothing or other product sizes and quantities, socialnetwork account information (e.g., login credentials and sharingpreferences), discounts, wish list preferences, previous purchases anditems already owned by a user, marketing and advertising targeting andpreferences, and merchant account numbers.

At step 320, service provider terminal 110 may receive environmentaldata comprising audio and visual information via a computing deviceassociated with the stored profile data (e.g., computing device 120).For example, audio and visual information may be obtained from abuilt-in or external camera or microphone associated with computingdevice 120.

At step 330, service provider terminal 110 may receive (e.g., from acomputing device associated with the stored profile data, such ascomputing device 120) first user input data indicative of a selection ofone or more items present in the physical environment. According to someembodiments, first user data may be derived from a user input, such as agesture or audible command detected by computing device 120. Forexample, a user may select a particular item that the user is viewing inthe world (or, in a virtual environment) by providing a selection input.In some embodiments, a selection input may include visually focusing(e.g., such that the item is within the field of view or a particulararea of the field of view of a camera associated with computing device120) on a particular item for more than a predetermined threshold oftime. In some embodiments, a user may select a particular item byfocusing a camera of, for example, computing device 120 (such as a smartphone or wearable headset), at the item and engaging a predeterminedinput that may be detected by computing device 120, such as selecting abutton, blinking, winking, or issuing a vocal command. In someembodiments, a selection input may include performing a detectablegesture associated with an item. For example, to select an item in auser's field of view, the user may make a grabbing gesture towards theitem such that the grabbing gesture may be detected by a cameraassociated with computing device 120. According to some embodiments, auser may select an item by some combination of inputs to computingdevice 120. For example, in some embodiments, a user may select an itemby visually focusing on the item and simultaneously issuing an audiblecommand that may be detected by computing device 120.

Having received the environmental data and first user input data, atstep 340 service provider terminal 110 may identify one or more actionitems in the visual information of the environmental data based on thefirst user input data. In some embodiments, the one or more action itemsmay be associated with the one or more selected items. Action items canbe identified by recognizing voice or auditory commands (e.g., a personmay verbally identify the item and merchant where the item waspurchased), shapes, labels, bar codes, QR codes, emitters, RFID tags, IRbeacons or Bluetooth™ beacons located in an environment (e.g., POSdevices 152, 154, and 156 associated with one or more products or itemsat a POS location or devices associated with different predefined areasof a closet, refrigerator, pantry, etc. that stores items that areperiodically repurchased), or the like. In some embodiments, identifyingone or more action items in the environmental data may involve usingimage recognition techniques. In some embodiments, the service providerterminal 110 may receive one or more 3-dimensional models of the one ormore selected items to aid in performing image recognition from, forexample, a merchant terminal 150 or merchant database 140. For example,a clothing merchant may provide service provider terminal 110 with3-dimensional models of a plurality of clothing items to aid serviceprovider terminal 110 in identifying a particular clothing item selectedby a user of computing device 120. Action items associated with selecteditems may include items that a user of the system observes as they movethrough the world (or through a virtual environment) that they may beinterested in purchasing such as clothing items, sports equipment, fooditems, books, bags, or any other consumer item.

At step 350, service provider terminal 110 may augment the environmentaldata by adding virtual environmental data. In some embodiments, thisaugmentation may involve displaying information from a merchant (e.g.,who may be associated with merchant database terminal 140 and/ormerchant POS terminal 150) that is specific to one of the one or more ofthe identified action items. For example, service provider terminal 110may recognize a particular item or product and augment the environmentwith visual effects such as a price tag, availability of the productand/or products of other brands or sizes, or aesthetic effects such asvirtual fireworks, sale signs, and the like. Service provider terminal110 can connect to an appropriate merchant database terminal 140 toinclude information relevant to the identified action item. For example,in the event that the identified action item is a clothing item, serviceprovider terminal 110 may connect to a clothing merchant databaseterminal (e.g., merchant database terminal 140), or in the event thatthe action item is a food item, service provider terminal 110 mayconnect to a grocery store database terminal (e.g., merchant databaseterminal 140).

In block 360, service provider terminal 110 may provide the virtualenvironmental data to computing device 120 in order to create anaugmented environment when viewed in combination with the physicalenvironment. For example, in some embodiments, computing device 120 maybe a wearable headset with a visual display (e.g., a heads up display)that may overlay information or images (e.g., derived from the virtualenvironmental data) on top of objects in the physical environment. Insome embodiments, computing device 120 may be a smart phone with amobile application that, in response to obtaining a photo of an item andidentifying the item in the phone (e.g., via service provider terminal110), may similarly overlay information and images on top of theidentified item when shown in the display. In some embodiments, thevirtual environment data may include some or all of the environmentaldata provided by computing device 120. In some embodiments, computingdevice 120 may only receive the newly generated virtual environmentaldata. The virtual environmental data may include product price, productinventory information, related products (e.g., other brands, sizes, ormodels), available discounts, and aesthetic visual effects (e.g., targetgraphics, glow, highlighted colors, or firework graphics displayedaround one or more products to draw attention to a particular item or toconvey a message associate with that item, such as being highlightedgreen for being on sale). Although this disclosure is generallydescribed with respect to use of an augmented environment, it will beunderstood by those of skill in the art that the system 100 may alsooperate substantially similarly in a virtual environment.

In block 370, service terminal provider terminal 110 may receive seconduser input data associated with the one or more action items fromcomputing device 120. In some embodiments, second user input data may beindicative of some action to be taken by the system 100 with respect toone or more action items. For example, second input user data may causethe system 100 to initiate the purchase of a selected item (e.g., forthe user or for a third party indicated by the user) or add the selecteditem to a wish list associated with the user (or otherwise bookmark theselected item for future consideration). Similar to first user inputdata describe above, second user input data may be derived from a userinput, such as a gesture or audible command detected by computing device120. In some embodiments, the service provider terminal 110 may takesome action in response to receiving second user input data derived froma predetermined gesture or command performed by a user. For example, thesystem 100 may initiate the purchase an item (e.g., by sending apurchase request data to a merchant terminal 150) to be sent to anaddress associated with the user in response to the user performing agesture including grabbing at an item. In some embodiments, the system100 may initiate the purchase of an item to be sent to an addressassociated with a third party in response to a user performing a gesturethat includes grabbing at the item and then making a throwing motion inthe direction of the third party. In some embodiments, the system 100may identify the third party using facial recognition techniques andaccess an address stored in association with the third party (e.g.,service terminal provider terminal 110 may access an address bookassociated with, for example computing device 120, to determine theaddress of the identified third party). According to some embodiments, auser or a third party (e.g., a friend of the user) may also berecognized by the system 100 using biometrics (e.g., voice recognition)or proximity assessment (e.g., based on something the third party iswearing or carrying). In some embodiments, the system 100 may add theitem to a wish list associated with the user if the user performs agesture that includes drawing a circle around the item with theirfinger. It should be recognized that the particular gestures describedherein are merely examples and that any conceivable gesture that may bedetectable by a computing device 120 may be utilized by system 100.

According to some embodiments, second user input data may be derivedfrom an authenticating gesture. In some embodiments, an authenticatinggesture may be a predetermined gesture or input that serves to instructthe system (e.g., service provider terminal 110) to take some actionwith respect to a selected item/action item (e.g., purchase item, additem to wish list) and to simultaneously verify the identity of the userattempting to initiate the action. For example, an authenticatinggesture may be a predetermined gesture such as a user signing their namein the air with their finger or speaking a password or pin. In someembodiments, the service provider terminal 110 may compare the seconduser input data 110 against stored authentication data to determine ifthe authenticating gesture input at computing device 120 is within apredetermined threshold level of similarity to a stored authenticatinggesture. In some embodiments, the service provider terminal 110 mayprevent the execution of a purchase transaction if the authenticatinggesture is not determined to be within a predetermined threshold levelof similarity to the stored authenticating gesture. According to someembodiments, authenticating gestures may be input, for example, by theuser of computing device 120 touching a screen, making a gesture in thevisual field of a video capturing component of computing device 120,speaking a command into an audio capturing component of computing device120, entering an input using a connected input device, or somecombination of these. In some embodiments, computing device 120 may be avirtual reality device including a headset and a camera. In suchembodiments, the user may be viewing the augmented environment, and mayphysically reach for an element in that environment to generate seconduser input data. The second user input data may then be transmitted toservice provider terminal 110 (e.g., by computer device 120 via network130).

In response to receiving the second user input data at block 370, atblock 380, service provider terminal 110 may provide transaction requestdata to the merchant database terminal 140 or merchant POS terminal 150in order to enable a transaction. In some embodiments, second user inputdata may correspond with a command to purchase a selected itemassociated with an action item. In some embodiments, the transactionrelated to the one or more action items may represent a purchase of theone or more selected items on behalf of a user of the computing device120. In some embodiments, the transaction related to the one or moreaction items may represent a purchase of the one or more selected itemson behalf of someone other than a user of the computing device, forexample, a purchase of a gift for a friend. In some embodiments, secondinput data may include a selection of a payment method for an itempurchase. For example, the second user input data may be the usergesturing to press a virtual “order” button associated with an actionitem, and service provider terminal 110 may connect to a merchantterminal 150 and provide payment information to complete the transactionwith the merchant to order the selected item corresponding to the actionitem.

In some embodiments, to provide the transaction request data, serviceprovider terminal 110 may transmit a purchase authorization request tofinancial service provider terminal 160, which may already have useraccount information associated with computing device 120. Once therequest has been authorized, service provider terminal 100 may transmita purchase request to merchant POS terminal 150 to purchase theidentified product(s) or to pay the identified bill(s). Alternatively,in other embodiments, service provider terminal 100 may add theidentified products or identified bills to a checkout cart associatedwith computing device 120 for purchase or payment at another time.

Optionally, in some embodiments, system 100 may facilitate anotheraction in lieu of or in addition to making a purchase. For example,system 100 may allow a user to add a selected item to a “wish list” suchthat a user may decide to purchase the item at a future time.

FIG. 4 shows a diagram that represents an embodiment of exemplary typesof virtual environmental data 400. For example, virtual environmentaldata 400 may include product price information 410, related productinformation 420, product availability between merchants 430, usercredential options 440, or aesthetic visual effects 450. Productinformation 410 can include, for example, a product price, stockinginformation, product features, and product reviews. Related productinformation 420 may include complementary products (e.g. batteries for adevice, matching tie for a shirt, etc.) or alternative products (e.g.value-sized items, more highly rated alternatives, comparable brands,etc.). Merchant information 430 can include prices, shipping costs, andavailability at various merchants, as well as merchant reviews. Usercredential options 440 can include individual family member profiles(e.g. this is for mom, dad, or child), credit cards, membership numbers(e.g. loyalty programs, frequent flier accounts, etc.), bank accountinformation, or merchant account passwords. Examples of aesthetic visualeffects may include product image graphics, glowing effects,highlighting objects with colors, or animations (e.g. firework graphics,waving flags, etc.).

As used in this application, the terms “component,” “module,” “system”and the like are intended to include a computer-related entity, such asbut not limited to hardware, firmware, a combination of hardware andsoftware, software, or software in execution. For example, a componentmay be, but is not limited to being, a process running on a processor,an object, an executable, a thread of execution, a program, and/or acomputer. By way of illustration, both an application running on acomputing device and the computing device can be a component. One ormore components can reside within a process and/or thread of executionand a component may be localized on one computer and/or distributedbetween two or more computers. In addition, these components can executefrom various computer readable media having various data structuresstored thereon. The components may communicate by way of local and/orremote processes such as in accordance with a signal having one or moredata packets, such as data from one component interacting with anothercomponent in a local system, distributed system, and/or across a networksuch as the Internet with other systems by way of the signal.

Certain embodiments and implementations of the disclosed technology aredescribed above with reference to block and flow diagrams of systems andmethods and/or computer program products according to exampleembodiments or implementations of the disclosed technology. It will beunderstood that one or more blocks of the block diagrams and flowdiagrams, and combinations of blocks in the block diagrams and flowdiagrams, respectively, can be implemented by computer-executableprogram instructions. Likewise, some blocks of the block diagrams andflow diagrams may not necessarily need to be performed in the orderpresented, may be repeated, or may not necessarily need to be performedat all, according to some embodiments or implementations of thedisclosed technology.

These computer-executable program instructions may be loaded onto ageneral-purpose computer, a special-purpose computer, a processor, orother programmable data processing apparatus to produce a particularmachine, such that the instructions that execute on the computer,processor, or other programmable data processing apparatus create meansfor implementing one or more functions specified in the flow diagramblock or blocks. These computer program instructions may also be storedin a computer-readable memory that can direct a computer or otherprogrammable data processing apparatus to function in a particularmanner, such that the instructions stored in the computer-readablememory produce an article of manufacture including instruction meansthat implement one or more functions specified in the flow diagram blockor blocks.

As an example, embodiments or implementations of the disclosedtechnology may provide for a computer program product, including acomputer-usable medium having a computer-readable program code orprogram instructions embodied therein, said computer-readable programcode adapted to be executed to implement one or more functions specifiedin the flow diagram block or blocks. Likewise, the computer programinstructions may be loaded onto a computer or other programmable dataprocessing apparatus to cause a series of operational elements or stepsto be performed on the computer or other programmable apparatus toproduce a computer-implemented process such that the instructions thatexecute on the computer or other programmable apparatus provide elementsor steps for implementing the functions specified in the flow diagramblock or blocks.

Accordingly, blocks of the block diagrams and flow diagrams supportcombinations of means for performing the specified functions,combinations of elements or steps for performing the specifiedfunctions, and program instruction means for performing the specifiedfunctions. It will also be understood that each block of the blockdiagrams and flow diagrams, and combinations of blocks in the blockdiagrams and flow diagrams, can be implemented by special-purpose,hardware-based computer systems that perform the specified functions,elements or steps, or combinations of special-purpose hardware andcomputer instructions.

Certain implementations of the disclosed technology are described abovewith reference to mobile computing devices. Those skilled in the artrecognize that there are several categories of mobile devices, generallyknown as portable computing devices that can run on batteries but arenot usually classified as laptops. For example, mobile devices caninclude, but are not limited to portable computers, tablet PCs, internettablets, PDAs, ultra mobile PCs (UMPCs), wearable devices, and smartphones. Additionally, implementations of the disclosed technology can beutilized with internet of things (IoT) devices, smart televisions andmedia devices, appliances, automobiles, toys, and voice command devices,along with peripherals that interface with these devices.

In this description, numerous specific details have been set forth. Itis to be understood, however, that implementations of the disclosedtechnology may be practiced without these specific details. In otherinstances, well-known methods, structures and techniques have not beenshown in detail in order not to obscure an understanding of thisdescription. References to “one embodiment,” “an embodiment,” “someembodiments,” “example embodiment,” “various embodiments,” “oneimplementation,” “an implementation,” “example implementation,” “variousimplementations,” “some implementations,” etc., indicate that theimplementation(s) of the disclosed technology so described may include aparticular feature, structure, or characteristic, but not everyimplementation necessarily includes the particular feature, structure,or characteristic. Further, repeated use of the phrase “in oneimplementation” does not necessarily refer to the same implementation,although it may.

Throughout the specification and the claims, the following terms take atleast the meanings explicitly associated herein, unless the contextclearly dictates otherwise. The term “connected” means that onefunction, feature, structure, or characteristic is directly joined to orin communication with another function, feature, structure, orcharacteristic. The term “coupled” means that one function, feature,structure, or characteristic is directly or indirectly joined to or incommunication with another function, feature, structure, orcharacteristic. The term “or” is intended to mean an inclusive “or.”Further, the terms “a,” “an,” and “the” are intended to mean one or moreunless specified otherwise or clear from the context to be directed to asingular form. By “comprising” or “containing” or “including” is meantthat at least the named element, or method step is present in article ormethod, but does not exclude the presence of other elements or methodsteps, even if the other such elements or method steps have the samefunction as what is named.

While certain embodiments of this disclosure have been described inconnection with what is presently considered to be the most practicaland various embodiments, it is to be understood that this disclosure isnot to be limited to the disclosed embodiments, but on the contrary, isintended to cover various modifications and equivalent arrangementsincluded within the scope of the appended claims. Although specificterms are employed herein, they are used in a generic and descriptivesense only and not for purposes of limitation.

This written description uses examples to disclose certain embodimentsof the technology and also to enable any person skilled in the art topractice certain embodiments of this technology, including making andusing any apparatuses or systems and performing any incorporatedmethods. The patentable scope of certain embodiments of the technologyis defined in the claims, and may include other examples that occur tothose skilled in the art. Such other examples are intended to be withinthe scope of the claims if they have structural elements that do notdiffer from the literal language of the claims, or if they includeequivalent structural elements with insubstantial differences from theliteral language of the claims.

Exemplary Use Cases

The following exemplary use case describes one example of a typical userflow pattern. It is intended solely for explanatory purposes and not inlimitation. The user may have credit card information and a deliveryaddress stored in the system (e.g., system 100), and may be walking downthe street using their mobile device (e.g., computing device 120). Theuser may see an item that they are interested in purchasing, such as ashirt that a passerby is wearing. The user may select the shirt by, forexample, staring at the item for at least 10 seconds, taking a picture,or performing a grabbing motion towards the shirt such that the grabbingmotion may be detected by a camera of their mobile device (e.g.,computing device 120). The system may then identify the selected shirtby, for example, performing image recognition techniques and comparingimages of the item obtained by the mobile device to a database of item(e.g., one or more merchant database terminals 140). Once the systemidentifies the item, it may provide an augmented environment to the user(e.g., via computing device 120) that may provide information (e.g.,visual and/or audible information) about the identified item, such asfor example, the price of the item and available merchants from whichthe shirt may be purchased. The user may then take an action relating tothe item, such as purchasing it for themselves, purchasing it as a giftfor someone else, or adding the item to a “wish list.” Each action maybe performed in response to a predetermined gesture. For example, theuser may purchase the selected item (e.g., from merchant POS terminal150) by performing a gesture such as grabbing at the item, at whichpoint the item may be automatically purchased and delivered to the userbased on stored financial account information and delivery address. Theuser may purchase the selected item for a friend by, for example,grabbing at the item and making a motion to “throw” the item towardstheir friend. The system (e.g., via service provider terminal 110) mayrecognize the friend using for example, facial recognition, and maypurchase the item with the user's stored financial account informationand send the item to an address stored in association with the friend.In some cases, the system may include security settings that requireuser authentication before authorizing a purchase. For example, beforeallowing the purchase, the user must perform an authenticating gesture,such as signing their name in the air with their finger or performing auser customized gesture or voice command that the system (e.g., viacomputing device 120) can detect. The system (e.g., via service providerterminal 110) may compare the gesture to a stored gesture, and if thesystem determines that the gestures match (within some margin of error)then the system will authorize the purchase. It should be understoodthat although this exemplary use case is described with respect to anaugmented environment, this system (e.g., system 100) may operate in avirtual environment as well.

Certain implementations of the disclosed technology are described abovewith reference to block and flow diagrams of systems and methods and/orcomputer program products according to example implementations of thedisclosed technology. It will be understood that one or more blocks ofthe block diagrams and flow diagrams, and combinations of blocks in theblock diagrams and flow diagrams, respectively, can be implemented bycomputer-executable program instructions. Likewise, some blocks of theblock diagrams and flow diagrams may not necessarily need to beperformed in the order presented, may be repeated, or may notnecessarily need to be performed at all, according to someimplementations of the disclosed technology.

These computer-executable program instructions may be loaded onto ageneral-purpose computer, a special-purpose computer, a processor, orother programmable data processing apparatus to produce a particularmachine, such that the instructions that execute on the computer,processor, or other programmable data processing apparatus create meansfor implementing one or more functions specified in the flow diagramblock or blocks. These computer program instructions may also be storedin a computer-readable memory that can direct a computer or otherprogrammable data processing apparatus to function in a particularmanner, such that the instructions stored in the computer-readablememory produce an article of manufacture including instruction meansthat implement one or more functions specified in the flow diagram blockor blocks. As an example, implementations of the disclosed technologymay provide for a computer program product, including a computer-usablemedium having a computer-readable program code or program instructionsembodied therein, said computer-readable program code adapted to beexecuted to implement one or more functions specified in the flowdiagram block or blocks. Likewise, the computer program instructions maybe loaded onto a computer or other programmable data processingapparatus to cause a series of operational elements or steps to beperformed on the computer or other programmable apparatus to produce acomputer-implemented process such that the instructions that execute onthe computer or other programmable apparatus provide elements or stepsfor implementing the functions specified in the flow diagram block orblocks.

Accordingly, blocks of the block diagrams and flow diagrams supportcombinations of means for performing the specified functions,combinations of elements or steps for performing the specifiedfunctions, and program instruction means for performing the specifiedfunctions. It will also be understood that each block of the blockdiagrams and flow diagrams, and combinations of blocks in the blockdiagrams and flow diagrams, can be implemented by special-purpose,hardware-based computer systems that perform the specified functions,elements or steps, or combinations of special-purpose hardware andcomputer instructions.

Throughout the specification and the claims, the following terms take atleast the meanings explicitly associated herein, unless the contextclearly dictates otherwise. The term “connected” means that onefunction, feature, structure, or characteristic is directly joined to orin communication with another function, feature, structure, orcharacteristic. The term “coupled” means that one function, feature,structure, or characteristic is directly or indirectly joined to or incommunication with another function, feature, structure, orcharacteristic. The term “or” is intended to mean an inclusive “or.”Further, the terms “a,” “an,” and “the” are intended to mean one or moreunless specified otherwise or clear from the context to be directed to asingular form.

As used herein, unless otherwise specified the use of the ordinaladjectives “first,” “second,” “third,” etc., to describe a commonobject, merely indicate that different instances of like objects arebeing referred to, and are not intended to imply that the objects sodescribed must be in a given sequence, either temporally, spatially, inranking, or in any other manner.

While certain implementations of the disclosed technology have beendescribed in connection with what is presently considered to be the mostpractical and various implementations, it is to be understood that thedisclosed technology is not to be limited to the disclosedimplementations, but on the contrary, is intended to cover variousmodifications and equivalent arrangements included within the scope ofthe appended claims. Although specific terms are employed herein, theyare used in a generic and descriptive sense only and not for purposes oflimitation.

This written description uses examples to disclose certainimplementations of the disclosed technology, including the best mode,and also to enable any person skilled in the art to practice certainimplementations of the disclosed technology, including making and usingany devices or systems and performing any incorporated methods. Thepatentable scope of certain implementations of the disclosed technologyis defined in the claims, and may include other examples that occur tothose skilled in the art. Such other examples are intended to be withinthe scope of the claims if they have structural elements that do notdiffer from the literal language of the claims, or if they includeequivalent structural elements with insubstantial differences from theliteral language of the claims.

The invention claimed is:
 1. A system for facilitating a transaction, comprising: a memory for storing profile data comprising user payment credentials and user profile information; an environmental data sensor for obtaining environmental data comprising audio and/or visual information representing a physical environment; a user interface device for generating user input data in response to one or more user inputs, including first user input data indicative of a selection of one or more items present in the physical environment, the first user input data being derived from an image of the one or more items present in the physical environment obtained by the environmental data sensor based on a first gesture made in association with the one or more action items; an augmented environment processor that, based on the first user input data and environmental data obtained from the environmental data sensor, identifies one or more action items in the environmental data that are associated with the one or more selected items based on an identification of the more or more selected items using image recognition techniques on the image, augments the environmental data by adding the virtual environmental data comprising enhanced content associated with one or more of the one or more action items, generates a signal comprising augmented environmental data, and generates purchase request data based on the one or more action items, the user profile information, and second user input data associated with one or more action items generated by the user interface device; an augmented environmental data display that receives the signal comprising augmented environmental data and displays said augmented environmental data in accordance with said signal; and an input/output device for transmitting the purchase request data to a merchant terminal; wherein the enhanced content is unrepresented in the physical environment.
 2. The system of claim 1, wherein the second user input data is generated in response to a second gesture indicating an instruction to purchase an item.
 3. A system for facilitating a transaction, comprising: one or more processors; and a memory in communication with the one or more processors and storing instructions that, when executed by the one or more processors, are configured to cause the system to: store profile data comprising user payment credentials and user profile information; receive, from a computing device associated with the stored profile data, environmental data comprising audio and visual information representing a physical environment; receive, from the computing device, first user input data indicative of a selection of one or more items present in the physical environment, the first user input data being derived from an image of the one or more items present in the physical environment obtained by a camera associated with the computing device based on a gesture made in association with the one or more items that is detected by the computing device; identify one or more action items in the environmental data based on the first user input data, the one or more action items being associated with the one or more selected items, the identification of the one or more action items being based on an identification of the one or more selected items using image recognition techniques on the image; augment the environmental data by adding virtual environmental data comprising enhanced content associated with one or more of the one or more action items, wherein the enhanced content is unrepresented in the physical environment; provide, to the computing device, the virtual environmental data to create an augmented environment in combination with the physical environment; receive second user input data associated with the one or more action items from the computing device; and provide, based on the second user input data, the one or more actions items, and the user profile information, purchase request data to a merchant terminal to enable a transaction related to the one or more action items, wherein the purchase request data comprises the stored user payment credentials.
 4. The system of claim 3, wherein the transaction related to the one or more action items represents a purchase of the one or more selected items on behalf of a user of the computing device.
 5. The system of claim 3, wherein the transaction related to the one or more action items represents a purchase of the one or more selected items on behalf of someone other than a user of the computing device.
 6. The system of claim 3, wherein the one or more processors are further configured to execute the instructions to cause the system to receive, from a merchant terminal, one or more 3-dimensional models of the one or more selected items to aid in performing image recognition.
 7. The system of claim 3, wherein identifying one or more action items in the environmental data based on the first user input data comprises detecting beacons.
 8. The system of claim 3, wherein the first user input data is further derived from an audible command detected by the computing device.
 9. The system of claim 3, wherein the gesture comprises focusing on an item for greater than a predetermined threshold period of time.
 10. The system of claim 3, wherein the gesture comprises making a grabbing motion towards an item.
 11. The system of claim 3 wherein the second user input data is derived from an authenticating gesture.
 12. A non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause a computer system to: store profile data comprising user payment credentials and user profile information; receive, from a computing device associated with the stored profile data, environmental data comprising audio and visual information representing a physical environment; receive, from the computing device, first user input data indicative of a selection of one or more items present in the physical environment, the first input data being derived from an image of the one or more items present in the physical environment obtained by a camera associated with the computing device based on a gesture made in association with the one or more items that is detected by the computing device; identify one or more action items in the environmental data based on the first user input data, the one or more action items being associated with the one or more selected items, the identification of the one or more action items being based on an identification of the one or more selected items using image recognition techniques on the image; augment the environmental data by adding virtual environmental data comprising enhanced content associated with the one or more action items, wherein the enhanced content is unrepresented in the physical environment; provide, to the computing device, the virtual environmental data to create an augmented environment in combination with the physical environment; receive second user input data associated with the one or more action items from the computing device; and provide, based on the second user input data, the one or more actions items, and the user profile information, purchase request data to a merchant terminal to enable a transaction related to the one or more action items, wherein the purchase request data comprises the stored user payment credentials.
 13. The non-transitory computer-readable medium of claim 12, wherein the transaction related to the one or more action items represents a purchase of the one or more selected items on behalf of a user of the computing device.
 14. The non-transitory computer-readable medium of claim 12, wherein the transaction related to the one or more action items represents a purchase of the one or more selected items on behalf of someone other than a user of the computing device.
 15. The non-transitory computer-readable medium of claim 12, wherein the first user input data is further derived from an audible command detected by the computing device.
 16. The non-transitory computer-readable medium of claim 12, wherein the second user input data is derived from an authenticating gesture.
 17. A method of facilitating a transaction, comprising: storing profile data comprising user payment credentials and user profile information; receiving, from a computing device associated with the stored profile data, environmental data comprising audio and visual information representing a physical environment; receiving, from the computing device, first user input data indicative of a selection of one or more items present in the physical environment, the first user input data being derived from an image of the one or more items present in the physical environment obtained by a camera associated with the computing device based on a gesture made in association with the one or more items that is detected by the computing device; identifying one or more action items in the environmental data based on the first user input data, the one or more action items being associated with the one or more selected items, the identification of the one or more action items being based on an identification of the one or more selected items using image recognition techniques on the image; augmenting the environmental data by adding virtual environmental data comprising enhanced content associated with one or more of the one or more action items, wherein the enhanced content is unrepresented in the physical environment; and providing, to the computing device, the virtual environmental data to create an augmented environment in combination with the physical environment.
 18. The method of claim 17, further comprising: receiving second user input data associated with the one or more of action items from the computing device; and providing, based on the second user input data, the one or more actions items, and the user profile information, purchase request data to a merchant terminal to enable a transaction related to the one or more action items, wherein the purchase request data comprises the stored user payment credentials.
 19. The method of claim 18, wherein the first user input data is further derived from an audible command detected by the computing device.
 20. The method of claim 18, wherein the second user input data is derived from an authenticating gesture. 